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DETAILED ACTION 



Claim Objections 

1 . Claim 47-50 is objected to because of the following informalities: 
Re claim 47-50: "The tour" has not been introduced in claim 38. 
"the tour" should be changed to ~a tour--. 

Appropriate correction is required. 

Claim Rejections - 35 USC §102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of appUcation for patent in the United States. 

3. Claims 18, 19, 21, 22, 3 1, 34, 38, 52 and 56 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Liu (US 5,480,306, as cited by the Applicant). 

Liu teaches a method and apparatus for providing information relevant to a physical 
world by reading a bar code associated with a sound data and the code is converted into a 
memory address pointer pointing to the initial address of the memory area in which the digital 
sound or pronunciation is stored and the sound applied to a loud speaker system (col 2 lines 
35+). Liu teaches that the bar code is printed on visible media, such as paper and plastic slides. 
The conversion from the bar code to the digital code then to an address pointer is considered be 
normalizing a read object label associated with object into an object identifier as discussed 
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above. And placing the object identifier into an index table repository and binding the content to 
the object identifier are taught in Fig 5A and Fig 5B. 

Re claim 19: Liu teaches that the language learning apparatus contains a digital sound 
data memory means (col 6 lines 30-32). 

Re claim 52: Liu teaches that the memory control means 5 may properly retrieve the 
desired digital speed data of the word from the memory means 6, which inherently shows that 
there is not pattern or sequential order for accessing, therefore it is randomly accessible. 

Re claim 56: The apparatus is a purpose build device targeted to read bar code. 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1-5, 9, 13, 16, 29, 30, 39-42, 57, 58, 61-63, 65-66 and 70 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Liu (US 5,480,306) in view of Savchenko et al (US 
6,111,567). 

Liu teaches a method and apparatus for reading a bar code associated with a sound data 
and the code is converted into a memory address pointer pointing to the initial address of the 
memory area in which the digital sound or pronunciation is stored, converted to an analog signal, 
and the sound applied to a loud speaker system (col 2 lines 35+). The apparatus 10 is considered 
to be a circuitry. Liu teaches that the bar code is printed on visible media, such as paper and 
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plastic slides. Liu teaches that the apparatus having a memory and a speaker means for 
outputting the sound (col 6 lines 22-59). 

Liu fails to teach a method for authoring information and a system for authoring the 
content. 

Savchenko teaches methods of authoring multimedia titles (col 1 lines 8-10). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Savchenko to the teachings of Liu in order 
to create a well organized system so that minimal memory is utilized, but at the same time 
provide a good quality sound and maintain the flow of the music or sound produced. 

Re claim 2 and 3: Liu fails to teach that the system for authoring content is resident in the 
apparatus, 

Savchenko teaches that the execution instructions for the authoring tool are contained in 
the memory (col 4 lines 39-47). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Savchenko to the teachings of Liu in order 
to provide a multifunctional apparatus so that the user may author and playback the sound 
according to his/her preference utilizing only one apparatus, which avoids complicated 
connections between multiple devices. 

Re claim 9: Liu fails to teach that the step of storing the content in non-volatile memory 
resident in the apparatus. 

Savchenko teaches that a computer application 42 is stored in the non-volatile memory 
34 (col 4 Unes 37-47). 
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Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Savchenko to the teachings of Liu in order 
to safely store the content so that the content is not easily changed or modified by others. 

Re claim 13: Savchenko further teaches a computer readable storage media having 
instructions for authoring information (col 4 lines 39-47). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Savchenko to the teachings of Liu in order 
to speed up the process by storing all the instruction in the memory and have the processor 
access and execute the instructions instead of loading or inputting the instructions one-by-one by 
the user. 

Re claim 16, 29 and 30: In addition to Liu as modified by Savchenko discussed above, 
the conversion fi*om the bar code to the digital code then to an address pointer is considered be 
normalizing a read object label associated with object into an object identifier as discussed 
above. And placing the object identifier into an index table repository and binding the content to 
the object identifier are taught in Fig 5A and Fig 5B. 

Re claim 42: Liu teaches that rendering digital multimedia as a function of output 
capabilities of the apparatus (col 6 lines 50-58). 

Liu fails to teach programming that renders digital multimedia as a function of output 
capabilities. 

Savchenko teaches a computer application 42 that executes instructions (col 4 lines 36- 

45). 
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Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Savchenko to the teachings of Liu in order 
to provide the proper sound signal that matches the output characteristics of the apparatus so that 
the user can listen to a good quality sound with less background noise and interruption. 

Re claim 61 : Liu teaches that a keyboard for inputting information (col 1 lines 13-25). 
6. . Claims 6 and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as 
modified by Savchenko as applied to claim 1 above and Liu as applied to claim 18, and further in 
view of Cave (US 5,958,014). Liu as modified by Savchenko and Liu have been discussed 
above. 

Liu as modified by Savchenko and Liu fail to teach that the content is a link to a live 

agent. 

Cave teaches device having audio capabilities and can be connected to a live agent (col 1 
lines 65+). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Cave to the teachings of Liu as modified by 
Savchenko in order to provide a two-way audio or text exchange to communicate with each other 
without remembering or dialing numbers, which also makes the process faster. 
7. Claims 7, 14, 36, 37, 47 and 51 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Liu as modified by Savchenko as applied to claim 1 and 13 above and Liu as applied to 
claim 38, and further in view of Conley, Jr. et al (US 6,434,745). 

Liu teaches receiving a plurality of optical codes (col 7 line 45). 
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Therefore, it would have been obvious to utiHze the steps of Liu as modified by 
Savchenko and repeat steps for as many coded labels necessary because it is a mere duplication 
of process. 

Liu as modified by Savchenko fails to teach aggregating the content into a single logical 
entity called a tour. 

Conley teaches that a tour component of the browser 8 allows the end-user to identify one 
or more URLs and save them into a group called a tour and to create one or more such tours, and 
to save each tour to a searchable local tour database on the end-user computer 14 similar to the 
searchable local image database. 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Conley to the teachings of Liu as modified 
by Savchenko in order to organize the data so that related data are grouped in the same group. 
Such modification helps and speeds up the searching process when the data needs to retrieved 
because the data are 

8. Claims 8, 15, 32, 33 and 35 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Liu as modified by Savchenko as applied to claim 1 and 13 above and Liu as applied to 
claim 31 above, and fiirther in view of Brooks et al (US 4,963,719). 

Liu as modified by Savchenko fails to teach detecting a second label associated with the 
first object and normalizing the first label and the second label such that the content bound to the 
first object can rendered during detection of either the first or second label in the playback mode. 

Brooks teaches two labels associated with the same object, two labels attached to an 
object and detecting two of the labels (Fig 2, col 2 lines 26+). 
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Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Brooks to the teachings of Liu as modified 
by Savchenko so that plurality of bar code labels having the same sound or data may be provided 
on different or multiple appliances for duplication or convenience purposes. 
9. Claim 10, 1 1, 12, 20, 25, 43-45 and 64 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Liu as modified by Savchenko as applied to claim 1, 40 and 63 above and over 
Liu as applied to claim 18 above, and further in view of Gluts (US 5,616,876). Liu as modified 
by Savchenko and Liu have been discussed above. 

Re claim 10, 20, 43 and 64: Liu as modified by Savchenko and Liu fail to teach a step of 
uploading and downloading the content to a remote server. 

Gluts teaches a remote server 34 utilized to transmit programming information for storage 
by one or more of the memory storage devices 30 (col 14-27). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Gluts to the teachings of Liu as modified by 
Savchenko because a remote server may provide more memory or storage space, which allows 
more data and information to be stored. 

Re claim 1 1 and 45: Liu as modified by Savchenko fails to teach that the step of 
uploading is performed via a wireless network. 

Gluts teaches a communication link is wireless (col 7 lines 14-27). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Gluts to the teachings of Liu as modified by 
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Savchenko because it does not require wired connection, therefore provides mobility and 
convenience. 

Re claim 12 and 44: Liu as modified by Savchenko fails to teach that the step of 
uploading is performed via a wired network. 

Gluts teaches a communication link is wired (col 7 lines 14-27). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Gluts to the teachings of Liu as modified by 
Savchenko because the possibility of data loss or corruption in transferred data decreases, 
therefore the modification provides a more accurate transmission of the data. 

Re claim 25: Liu fails to teach that the step of rendering the content comprises streaming 
the content from a remote server. 

Savchenko teaches rendering the content comprise streaming the content (col 1 lines 28- 

31). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Savchenko to the teachings of Liu in order 
to transmit the sound file through communication links using industry standards, such as MPEG 
standards. 

Liu as modified by Savchenko fails to teach a remote server. 

Gluts teaches a remote server 34 utilized to transmit programming information for storage 
by one or more of the memory storage devices 30 (col 14-27). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Gluts to the teachings of Liu as modified by 
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Savchenko because a remote server may provide more memory or storage space, which allows 
more data and information to be stored. 

10. Claims 17, 60 and 69 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liu 
as modified by Savchenko as applied to claims 16, 57 and 63 above, and further in view of 
Bridgelall (US 6,264,106). Liu as modified by Savchenko have been discussed above. 

Liu as modified by Savchenko fail to disclose that the instructions allow a plurality of 
different label types to be normalized to one object identifier. 

Bridgelall teaches a combination bar code scanner/RFID circuit for reading bar code or 
RFID (col 2 lines 20+). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Bridgelall to the teachings of Liu as 
modified by Savchenko because bar code and RFID tags are commonly known forms of 
identification and combining those two functions into one device will provide the flexibility of 
reading different types of codes. 

1 1 . Claim 24 is rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as applied to 
claim 18 above, and further in view of Fan et al (US 6,324,165). Liu has been discussed above. 

Liu fails to teach determining the current time and comparing the current time to the 

timestamp before rendering the content- 
Fan teaches a timer issuing a current time and a comparator for comparing the queue 

timestamp to the current time (col 27 lines 7-12). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 

the invention was made to integrate the teachings of Fan to the teachings of Liu in order to 
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provide a data that corresponds to the current time by checking to see if the current time and 
timestamp corresponds to each other. 

12. Claims 26 and 27 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as 
applied to claim 18 above, and further in viev^ of Boulton et al (US 5,566,291). Liu has been 
discussed above. 

Liu further teaches that the language learning apparatus contains a digital sound data 
memory means (col 6 Hnes 30-32). 

Liu fails to teach that the steps of accepting annotations/feedback after the rendering of 
the content and binding the annotations/feedback to the object identifier. 

Bouhon teaches an object identifier field 200 that stores an object identifier which 
references an object the user may be referencing with his or her feedback information. In 
Boulton's feedback system, objects can be used to further define the context when the feedback 
is provided (col 25 lines 55+). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Boulton to the teachings of Liu in order to 
enhance the content and provide a better quality sound, image, etc. to the user by editing or 
making additional comments to the content. 

13. Claim 28 is rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as modified 
by Bouhon as applied to claim 26 above, and further in view of Cluts. 

Liu as modified by Boulton fails to disclose the step of storing the annotations/feeback in 
a remote memory. 
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Gluts teaches a remote server 34 utilized to transmit programming information for storage 
by one or more of the memory storage devices 30 (col 14-27). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Gluts to the teachings of Liu as modified by 
Bouhon because a remote server may provide more memory or storage space, which allows 
more data and information to be stored. 

14. Glaim 46 is rejected under 35 U.S.G. 103(a) as being unpatentable over Liu as modified 
by Savchenko and Gluts as applied to claim 45 above, and further in view of Aguirre et al (US 
6,195,531). Liu/Savchenko/Gluts have been discussed above. 

Liu/Savchenko/Gluts fails to teach that the wireless network comprises a cellular 
telephone network. 

Aguirre teaches a cellular telephone network (col 3 lines 26-40). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Aguirre to the teachings of 
Liu/Savchenko/Gluts because it is a widely used wireless network method for providing a safe 
and reliable data transmission, which enhances the accuracy of the data being transmitted. 

15. Glaims 48 and 49 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as 
applied to claim 38 above, and further in view of Cole et al (US 6,359,71 1). Liu have been 
discussed above. 

Liu fails to disclose that the apparatus accesses the tour via the internet and a voice 

portal. 
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Cole teaches a portable computer with access methods of voicemail and internet (col 2 
lines 10-15). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Cole to the teachings of Liu because it is a 
fast method to communicate and transmit data using a conventional phone line, which is 
commonly available. 

16- Claim 50 is rejected under 35 U,S.C. 103(a) as being unpatentable over Liu as applied to 
claim 38 above, and further in view of Aguirre and Cole. 

Liu fails to teach that the apparatus accesses the tour via a cellular telephone voice 
mailbox. 

Aguirre teaches a cellular telephone network (col 3 lines 26-40). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Aguirre to the teachings of 
Liu/Savchenko/Cluts because it is a widely used wireless network method for providing a safe 
and reliable data transmission, which enhances the accuracy of the data being transmitted. 

Cole teaches a portable computer with access methods of voicemail and internet (col 2 
lines 10-15). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Cole to the teachings of Liu because it is a 
fast method to communicate and transmit data using a conventional phone line, which is 
commonly available. 
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17. Claim 53 is rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as applied to 
claim 38 above, and ftirther in view of Krueger (US 5,598,540). Liu has been discussed above. 

Liu fails to teach that the digital multimedia is accessible by the apparatus in a sequential 

order. 

Krueger teaches accessing the stored data only in sequential order (Abstract). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Krueger to the teachings of Liu in case 
presentation of the digital multimedia must be in a certain order for the user to understand certain 
topics before achieving the next data so that the next data makes more sense to the user. 

18. Claims 54 and 55 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as 
applied to claim 38 above, and further in view of Ramachandran (US 6,315,195). Liu has been 
discussed above. 

Liu fails to teach that the apparatus comprises a personal digital assistant and a cellular 
telephone. 

Ramachandran teaches a portable terminal 14 that reads bar codes and also may be 
integrated into a carrier 62, which may be a personal digital assistant or a cellular phone (col 8 
lines 23-26, col 9 lines 35-42). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Ramachandran to the teachings of Liu 
because both personal digital assistant and cellular phones have the capability of storing 
information and also wirelessly transmitting information through internet and other 
communication methods, which enhances the voice data and play back as well 
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19. Claims 59 and 67 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liu as 
modified by Savchenko as applied to claim 57 and 63 above, and further in view of Chen et al 
(US 5,869,820). Liu as modified by Savchenko have been discussed above. 

Liu as modified by Savchenko fails to teach that the circuitry comprises an IR tag reader. 
Chen teaches an infrared tag reader (col 8 line 5). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Chen to the teachings of Liu as modified by 
Savchenko because IR tags are readily available tags that are also used for identification 
purposes and it utilizes wireless communication, which provides mobility and faster process. 

20. Claim 68 is rejected under 35 U.S.C, 103(a) as being unpatentable over Liu as modified 
by Savchenko as applied to claim 63 above, and further in view of Bertram et al (US 5,613,137), 
Liu as modified by Savchenko have been discussed above. 

Liu as modified by Savchenko fails to teach a circuitry determining a coordinate location. 

Bertram teaches a coordinate determining circuitry 302 configured to determine 
corresponding locations of the touch on the coordinate sensor (col 15 lines 20-28). 

Therefore, it would have been obvious to an artisan of ordinary skill in the art at the time 
the invention was made to integrate the teachings of Bertram to the teachings of Liu as modified 
by Savchenko in order to determine the location of the touch pad sensor input that provides the 
information regarding the identification of the content to be retrieved and played back. 



• 
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Conclusion 



21 . The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Savchenko et al., U.S. Patent No. 6,343,298, discloses a seamless multimedia branching. 

Swartz et al., U.S. Patent No, 6,095,418, discloses an apparatus for processing symbol 
encoded document information. 

Kikuda, U.S. Patent No 4,952,785, discloses a bar code generating apparatus for image 
communication terminal device. 

Raistrick et ai., U.S. Patent No. 5,971,279, discloses a hand held scanner for the visually 
impaired. 

Citron et a!., U.S. Patent No. 5,288,976, discloses a bar code use in information, 
transactional and other system and service applications. 

Kunizawa et aL, U.S. Patent No. 4,964,167, discloses an apparatus for generating 
synthesized voice from text. 

Knowles discloses a hand-held portable www access terminal with visual display panel 
an gui-based www browser program integrated with bar code symbol reader in a hand- 
supportable housing. 

Hoda et al., U.S. Patent No. 4,831,610, discloses method and apparatus for interactive 
control of a data recording medium playback apparatus using bar code access. 

Barton et al., U.S. Patent No. 5,998,752, discloses a sorting system. 

Dyko et al, U.S. Patent No. 5,956,708, discloses an integration of link generation cross- 
author user navigation, and reuse identification in authoring process. 




• 
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Wilz, Sr. et al., U.S Patent No. 5,992,752, discloses an internet-based system for enabling 
information-related transactions over the internet using java-enabled internet terminals provided 
with reading java-applet encoded bar code symbols. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kumiko C. Koyama whose telephone number is 703-305-5425. 
The examiner can normally be reached on Monday-Friday 7am-3 :30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael G. Lee can be reached on 703-305-3503. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-308-7722 for regular 
communications and 703-308-7722 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-308-0956. 
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March 7, 2003 




